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ABSTRACT 


In  this  note,  we  derive  the  asymptotic  distribution  of 
logarithm  of  the  likelihood  ratio  statistic  for  testing  the 
hypothesis  that  the  number  of  signals  Is  equal  to  q  against 
the  alternative  that  It  Is  equal  to  k  (specified)  for  a  special 
case.  This  distribution  Is  not  chi-square.  The  above  statistic 
also  arises  (see  Wax  and  Kallath  (1983))  In  studying  consistency 
property  of  MDL  and  AIC  criteria  for  detection  of  the  number  of 
signals. 
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1.  INTRODUCTION 


In  the  area  of  signal  processing,  a  model  that  Is  often  used 
involves  modeling  the  observation  (complex)  vector  as  a  linear 
COTiblnation  of  the  elements  of  the  signal  vector  and  vector 
of  white  noise.  Under  this  model,  the  (unknown)  number  of 
signals  is  related  to  the  multiplicity  of  the  smallest  eigen¬ 
value  of  the  covariance  matrix  of  the  observation  vector. 
Recently,  Weuc  and  Kallath  (1985)  used  Akalke's  AIC  criterion 
and  Schwartz-Rissanen's  MDL  criterion  for  determination  of 
the  number  of  signals  and  stated  that  the  AIC  criterion  is 
not  consistent  whereas  the  MDL  criterion  is  consistent. 

Parts  of  the  proofs  of  the  above  stat^ents  are  based  upon 
the  assuna)tlon  that  the  asymptotic  distribution  of  -2  log  L^j^, 
is  chi-square  where  denotes  the  likelihood  ratio  test 
statistic  for  testing  Kj.  against  Hj^  where  t  euid  k(k  >  t)  are 
specified.  In  this  note,  we  derive  the  asymptotic  distribu¬ 
tion  of  the  above  test  statistic  for  trivarlate  case  and  point 
out  that  it  is  not  chi-square.  We  will  also  derive  analogous 
result  when  the  underlying  distribution  is  real  multivariate 
normal. 
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2.  SOME  CRITERIA  FOR  DETECTION  OF  SIGNALS 
Consider  the  model 

x(t)  =  As(t)  +  n(t)  (2.1) 

where  A  -  [A(*]^),. . .  ,A(J^)],  8(t)  =  (s^(t ) , . . .  ,Sq(t)  ) ' ,  Sj^(t)  is 
complex  waveform  associated  with  1-th  signal,  A()(^)  Is  a  complex 
vector  which  depends  upon  the  unknown  vector  associated  with  1-th 
signal,  n(t)  Is  noise  vector.  Also,  s(t)  and  n(t)  are  distributed 
Independently  as  complex  multivariate  normal  with  E(£(t))  =  0, 
E(n(t))  =  2»  E(.£(t)?rF7‘)  »  'J^and  E(ji(t)arET’ )  *  where  is 

unknown.  Here  and  y  respectively  denote  the  trsuispose  and  con¬ 
jugate  of  2.  The  nuaiber  of  signals  q  is  unknown.  Also,  x(tj^)..., 
x(t^)  is  a  sample  from  a  complex  multivariate  normal  population 
with  mean  vector  0  and  covariance  matrix  2^.  Now,  let  denote 
the  t-th  model  which  states  that  the  number  of  signals  is  t. 

Wax  and  Kalla th  (1983)  proposed  using  the  AIC  criterion  and  MDL 
criterion  for  the  selection  of  the  number  of  signals.  According  to 
the  AIC  criterion,  we  select  the  model  for  which 

AlC(t)  -  -2  log  +  v(t,p)  (2.3) 

is  minimum  where  v(t,p)  •  t(2p  -  t)  +  1.  According  to  the  MDL 
criterion,  we  select  the  model  for  which 

MDL(t)  -  -  log  Li  +  v(t.p)log  n  (2.4) 

^  2 

is  minimum.  Now,  let  denote  the  hypothesis  that  the  number  of 
signals  is  equal  to  t.  The  logarithm  of  the  likelihood  ratio 
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test  statistic  for  testing  against  for  specified  values 

of  r  and  k  (r  <  k)  is  known  to  be  log  -  log  Lj^  where 

P  P 

log  =  -  nf  E  log  £.  -  log(  S  i./(p  -  t))).  (2.5) 

Wax  and  Kalla th  (I985)  pointed  out  that  the  MDL  criterion  is 
consistent  whereas  the  AIC  criterion  is  not  consistent.  In  the 
proofs  of  the  above  statements «  they  have  Incorrectly  assumed 
that  -2  log  is  distributed  asymptotically  as  chi-square. 

Now  let  £  denote  the  parametric  space.  Itoder  H^,  the 
supremum  of  the  logarithm  of  the  likelihood  function,  L(0), 
might  be  reached  at  a  boundary  point  of  £  and  not  in  any 


inner  point;  such  a  point  is  X^^^^ 

P 

=  E  £>a/(V  -  t).  So  the  conditions  for  -2  log  L  to  be 
P  4=t+l  ^ 


distributed  as  chi-square  asymptotically  are  not  satisfied.  In 
Section  3»  we  derive  the  asymptotic  distribution  of  -2  log 
for  the  special  case  when  p  »  3*  Analogous  result  is  also  de¬ 
rived  when  x(t)  is  distributed  as  real  multivariate  normal  with 
mean  vector  0  and  covariance  matrix  Z^. 
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3.  DISTRIBUTIONS  OF  THE  LRT  STATISTICS 
FOR  DETECTION  OF  NUMBER  OF  SIGNALS 

In  this  section,  we  will  derive  the  asymptotic  distribution 
of  -2  log  when  p  =  3*  r  =  0  and  k  =  1.  The  following  defini¬ 
tion  of  complex  Gaussian  matrix  is  needed  in  the  sequel. 

Let  A=(aj^)  =R+iS,  where  A:  pxp  is  a  Hermitlan  random 
matrix,  R  =  Assume  Sjj  =  0,  and  the  distinct 

elements  of  R  and  the  upper-diagonal  elements  of  S  are  Independent 
real  normal  variables.  Also,  we  assume  that  the  variances  of  the 
off-diagonal  elements  of  R  and  S  are  equal  to  1  and  the  variances 
of  the  diagonal  elements  of  R  are  equal  to  2.  Then,  A  =  R  +  IS 
is  known  (see  Krlshnaiah  (1976))  to  be  the  central  or  noncentral 
complex  Gaussian  matrix  accordingly  as  E(A)  “  0  or  E(A)  ^0. 

Now,  let  x^,...,jp^  be  distributed  Independently  as  complex 
trlvarlate  normal  with  mean  vector  0  and  covariance  matrix  I,  where 
I^  is  €ui  identity  matrix  of  order  3x3.  Also,  let  >  >^2  — 
the  roots  of  the  equation. 


Rewrite  this  equation  as 


(3.1) 


J  *1 

By  the  central  limit  theorem,  we  have 


(3.2) 


*(V55(i  r  -  I3))  -  £{A3) 


(3.3) 


as  n  •  where  is  3*3  central  complex  Gaussiem  matrix.  So  the 
asymptotic  distribution  of  Is  the  same  as 

distribution  of  the  eigenvalues  >  Tg  >  of  A^.  It  Is  well 
known  (see  Wlgner  (I965))  that  the  Joint  density  of  (T^jTg^T^)  Is 


h(t,,t2,to)  =  Cf  II  (t.-t  )^)exp(-  r  t?/4), 
^  l<J<m<3  ^  J=1 


(3.4) 


•  >  tj^  >  tg  >  t^  >  -•. 


where 


C  «  2-V3/2, 


Since  llm(i.-l)  =  0  a.s.,  we  can  use  Taylor’s  expansion  and 

n-»*» 


get  from  (2.5), 


-  2[Sup  L(e)  -  Sup  L(9)] 


(3.5) 


3  3 

[n(Vl)2  +  |(  S  (VI))®  -  7(  (V’'))®)(^+°(^>)  »•  =  • 

^  J..®  "■  ^  J-1 


Here,  denotes  the  parameter  space  under  Hj^. 


Write 


W_  =  -  2[Sup  L(£)  -  Sup  L(9)]. 
”  Gee,  GcQ^ 


Then 


"n  '  J  ’’!  +  ¥<^’■3)^  -  ■5(''l+V’'3)®* 


(3.6) 


as  n  Now,  let  n,  *  —  t,  ,  =  —  r~,r\^  =  —  t*. 

1  2  ^23  ^3 


Then 


8  2  1  2  1  2  ^ 


(3.7) 
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where  the  Joint  density  of  is 

8  ( *  ^2  » ) 


=  2-5/2„-3/£exp(- 


(3.8) 


If  we  write 


then  -  hg  =  Jf 


2 

0 

_1_ 

1 

1 

1 

1 

_l_ 

1 

JS  ‘ 

^/5■ 

^/7 

■J? 

Yg, 

^2  “ 

t;|’'l  -  i-  (3.9) 


Thus  the  Joint  density  of  (Y^,Y2,Y2)  Is 

YCy^, 72^73)  =  2"'^/2TT'3'^^(3yi-y|)^y|expC-  ^{y\+v\+Y^)) 

(3.10) 

V^Yi  >  yg  >  0,  -  •  <  y^  <  •. 

Hence,  the  density  of  Y^^  is 

fl(yi)  =  2'V^J  (371-72 )^y|exp[-  ^( y^+y^ ) ] dyg .  71  >  0. 

(3.11) 


So  the  density  of  is 

a(u)  =  ^  u"^/^f^(v'u)  =  2'^Tr“^u“^/^e“'^'^^J  (3u-y®')'^y^i«r^'^^dy,  u  >  0, 

o 

Now,  let 

X  2 

Jk(x)  =  r  y^Vy  ^dy,  k  =  0,1,2,3. 


(3.12) 


Then  we  have 


Jl^.(x)  =  -  +  2(k-l)jj^_^ 


(X) 


(3.13) 


for  k  *  1,2,3.  Thus, 


2 

J2(x)  =  (-x5-5x3-15x)e"*  +  15Jq(x), 


2 

J2(x)  =  (-x3-3x)e'^  +  3Jo(x), 

2 

Jl(x)  =  -»■*  ^  +  Jo(*)- 


(3.14) 


So,  we  have 


=  1  „-l/2..-u/2 


^  -  6uJ2(-s/5u)  +  9u‘'j^(.y5u)] 

=  u-^/V'"/2f((3u)3/2.i5^je-3u/2 


+  (9u2  -18u+15)Jq(v^)] 


(3.15) 


(3^^-15^y?)e■2'^  +  u-^/V'^^(9u2-l8u+15)Jo(-^y3u), 


(u  >  0). 
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where 

-s/3u  2 

o 

From  (3*7)»  (3*9)  and  (3*15)»  it  follows  that  the  asymptotic  dis¬ 
tribution  of  W  *  -  2[Sup  L(0)  -  Sup  L(e)]  is  not  chi-square. 

"  *■  ~ 

In  view  of  the  above  counter  example,  the  strong  consistency 
of  the  MDL  criterion  does  not  follow  from  the  argument  of  Wax  and 
Kailath  (1985)*  But,  it  follows  from  the  results  given  in  a  com¬ 
panion  paper  by  Zhao,  Krishnaiah  and  Bai  (I985). 


Now  we  suppose  that  x^,...,x^  are  pxl  i.i.d.  real  normal 
random  vectors  with  =  0  and  =  T  >  0.  We  point  out  that 


the  asymptotic  distribution  of  -2[Sup  L(S)  -  Sup  L(0)]  here  also 
is  not  chi-square.  ^  ^ 


Now  let  R  =*  P*P  ®  symmetric  random  matrix.  We 

assume  that  J<m«l,..,,p}  are  independent  normal  variables 

with  means  zero,  var(rjj)  =  1  and  var(rj^)  =  1/2  for  all 
J  <  £.  Then  R  is  toiown  to  be  distributed  as  (real)  central  or 
noncentral  Gaussian  matrix  accordingly  as  E(R)  =  0  or  not. 

Let  >  £-  be  the  eigenvalues  of  ^  Hx.xl  and 

1—2—3 

>  Tg  >  be  the  eigenvalues  of  3*3  central  (real)  Gaussian 
matrix.  Then,  using  the  same  argument  as  before,  the  Joint  dis¬ 
tribution  of  ^(-^^-1,^2-!, ^®nds  to  that  of 

It  is  well  known  (e.g.,  see  Anderson  (198^))  that  the  Joint  den¬ 
sity  of  (t,,t„,To)  Is  given  by 


*  !>•  1*4, ■> 


,‘is5 


(3.17) 


(•  >  >  tg  >  t^  >  -•). 


Let  Y,  =  —  T-  — ^(To+t-s),  Yo  =  — (To-t-),  Y^  =  — (t,+t-+t-). 
Then  the  Joint  density  of  (Y^,Y2,Y2)  is  given  by 


fCy^, 72*73)  =  ^(37i-7|)72expf-  -1(71+71+73)} 


^  ^2  ^  -•  <  73  < 


(3.18) 


Using  the  same  argument,  we  have 


W„  -  W  =  Yf . 


(3.19) 


By  (3.18),  the  density  of  Y^  is 

J  ( 3yi-y| ) ygexp  f ~  i ( y^+yl ) }  dyg 

-v^TT  O 

=  ^(3y2.2)e"^^  +  ,  71  >  0. 


(3.20) 


Thus,  the  density  of  W  is 


2^/5tt 


(3.21) 


Prom  (3.19)  and  (3.21),  it  follows  that  the  asymptotic  dis¬ 
tribution  of  W  =  -2[Sup  L(0)  -  Sup  L(0)]  is  not  chi-square 

0€O,  ^  0€©  ~ 

distribution,  -  ~i  *-o 


jf  vm  m 
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